Scaling of Lyapunov exponents in chaotic delay systems 
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The scaling behavior of the maximal Lyapunov exponent in chaotic systems with time-delayed 
feedback is investigated. For large delay times it has been shown that the delay-dependence of the 
exponent allows a distinction between strong and weak chaos, which are the analogy to strong and 
weak instability of periodic orbits in a delay system. We find significant differences between scaling 
of exponents in periodic or chaotic systems. We show that chaotic scaling is related to fluctuations 
in the linearized equations of motion. A linear delay system including multiplicative noise shows 
the same properties as the deterministic chaotic systems. 
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The cooperative behavior of nonlinear units is an ac- 
tive field of research, both from a fundamental point of 
view but also with applications in different scientific dis- 
ciplines, from neurons to lasers The nonlinear units 
interact by transmitting signals to their neighbors. Of- 
ten the transmission time is longer than the internal time 
scales of these units; the coupling has a delay time. Dy- 
namical systems with time-delayed couplings may lead 
to high-dimensional chaos, and networks of such units 
may synchronize to clusters of common chaotic trajec- 
tories 0. Chaos is characterized by the maximal Lya- 
punov exponent of the network which measures the sen- 
sitivity to initial conditions. In this Letter we study 
a fundamental aspect of dynamical systems with time- 
delayed feedback, namely the scaling of the Lyapunov 
exponent with the delay time. We find that the scal- 
ing behavior of chaotic systems shows anomalies com- 
pared to the corresponding scaling of periodic systems 
with time-delayed couplings. These anomalies can be re- 
lated to linear networks with time-delayed couplings and 
multiplicative noise. We consider a nonlinear dynamical 
system defined by the equations of motion 



x = f (x) + K • x T 



(1) 



where x = x(t) £ R and x T = x(i — r), with the de- 
lay time t > 0. For simplicity we choose linear coupling 
described by the matrix K € Hl NxN . The vector field 
f : K w — ► R w can be an arbitrary but smooth and dif- 
fercntiablc nonlinear function. Our model also includes 
large complex systems, i.e., the function f (•) can describe 
many nonlinear dynamical nodes of a network, each of 
them with several degrees of freedom. In such a delay- 
coupled network the matrix K would correspond to the 
interaction strengths between the nodes. We are inter- 
ested in Lyapunov exponents of the system described by 
Eq. JT]). A Lyapunov exponent is a measure for the evo- 
lution of a small perturbation, which is calculated by 
linearizing Eq. ([I]) 



HereDf(x) denotes the Jacobian of f(-) with (Df(x))y- = 
dfi/dxj\ x ( t )- It is evaluated at the trajectory x(i) and 
is therefore a time-dependent matrix. In presence of 
a chaotic trajectory x(i) the matrix elements are non- 
periodic. The Lyapunov exponent is defined from the 
evolution of the linear system Eq. (|2|) with typical initial 
conditions 
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For the following discussion, A denotes the maximum 
Lyapunov exponent on a typical chaotic attractor. 

Strong and weak chaos. For sufficiently large delay 
t ^> To, where tq is system-dependent, recently it has 
been shown, that the maximum Lyapunov exponent A as 
a function of the delay time shows two major types of 
scaling called strong or weak chaos 0]. In strong chaos, 
the Lyapunov exponent reaches a limit value 



lim A(r) = Aq 



(4) 



In weak chaos, A decreases towards zero in the same limit. 
But it scales with the delay time as A oc t _1 , such that 



lim 



A(r) = A 



(5) 



We call the product Ar the delay-normalized Lyapunov 
exponent. The scaling of A, by which wc distinguish be- 
tween strong and weak chaos, depends on the sign of an 
auxiliary exponent Ao- This exponent is given by the par- 
tial linearization of Eq. (JlJ , in which the delayed feedback 
is omitted 



(5xq = Df (x) • i5xq 



(6) 



Note that, however, the full trajectory x(t) of the delay 
system {T]) enters both linearizations Eq. ([2]) and Eq. ([6]) . 
The auxiliary exponent then reads 



<5x = Df (x) • <5x + K • Sx T 



(2) 
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In the following we call it the sub-exponent, because it is 
a special conditional exponent describing a subsystem of 
the original system If A > 0, there is strong chaos 
and A from Eq. and Eq. ([7]) coincide. Otherwise, if 
Ao < 0, weak chaos is present and the limit fi from Eq. (IS]) 
does not depend trivially on Ao like in strong chaos [3[. 

Periodic dynamics The delay system Eq. ([T]) may 
have unstable periodic solutions x(£) = x(t+T p ) with pe- 
riod T p = r/n, n <G N, including fixed points x(i) = x*. 
Such a periodic orbit reappears periodically, when the 
delay time is varied [||. So it is possible to define and 
observe scaling laws of its Lyapunov exponent, which is 
the real part of the so-called Floquet exponent for orbits. 
In analogy to strong and weak chaos, the orbit would be 
called strongly or weakly unstable, if its sub-exponent is 
positive or negative, respectively. We show three scal- 
ing laws for the Lyapunov exponent of periodic orbits, 
which in case of diagonal coupling K = kl can be de- 
rived analytically. These laws remain valid for arbitrary 
coupling. Eq. ((2|) can be transformed into a system with 
only constant coefficients {A^} by the Floquet-ansatz 
Sz(t) = Q(i) • Sx(t), where Q(t) = Q(t + t) is a suitable 
transformation matrix The resulting system 

Sz = A-Sz + k- 5z T (8) 

provides a characteristic equation, which reveals the 
maximum Lyapunov exponent 

A = 9? jA + iw(fcTe-( Ao+ ^ T ) j . (9) 

Here Ao is the sub-exponent, which is the maximum real 
part of the eigenvalues of A. W : C — > C is the Lambert 
function with W(z) exp(W(z)) = z for z G C. The imag- 
inary part wo can be omitted for large delay times [7j. 
From the general expression Eq. , we derive three lim- 
iting expressions. For strong instability Ao > and large 
delay times it reads 

A = A + kc- x ° T , (10) 

meaning that the difference A — Ao vanishes exponentially 
with increasing r. For weak instability Ao < the limit of 
the delay-normalized exponent lim tA(t) = fl becomes 

T— f OO 

„ = ,„(- A). oi) 

When a system parameter in Eq. ([I]) is changed, Ao may 
cross zero and one observes a transition from weak to 
strong instability. Eq. (fTTj) shows, that jj, diverges log- 
arithmically with Ao, when the transition point is ap- 
proached. Finally, at the critical point Ao = the delay- 
normalized exponent scales with respect to r as 

Ar=W(fcr). (12) 
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FIG. 1. Lyapunov exponents for logistic map with delayed 
feedback. Top left: Ao(fc) (lower curve, thin) and X(k) (up- 
per curve, thick) for r = 100 with transitions between strong 
and weak chaos. Bar at arrow (c) indicates selected interval 
in figure (c). (a): Convergence of A(r) towards Ao in strong 
chaos (big dots), compared with the curve fc-exp(— Aot) (small 
dots), (b): A(t) • r at critical point Ao = (big dots), com- 
pared with W(fcr) (small dots) and i/t (dashed), (c): Ar(Ao) 
in weak chaos (solid lines) for r = 10™, n £ {3,4,5,6}, com- 
pared with ln(— k/Xo) (small dots) and l/|Ao| (dashed). 

Anomalous scaling. Returning to chaotic dynamics, 
we observe a significant deviation from each of the 
three scaling laws presented above. These anomalies are 
present in every chaotic system with time-delayed self- 
feedback, which we have studied, including the Rdssler, 
Lorenz and Lang-Kobayashi model as well as the Henon 
map, logistic map and skew tent map. We conclude that 
this behavior is generic. Exceptions are the Bernoulli 
map and the continuous Ikeda system, where the drive 
terms are constants. We exemplify the anomalous scal- 
ing by means of the logistic map M(x) = 4x(l — x) with 
time-delayed feedback 

x t+ i = (1 - k)M (x t ) + kM{x t -r) , (13) 

where t € Z and r € N are normalized by the time 
step of the map. The scaling laws as presented in the 
following are the same for continuous flows and for dis- 
crete maps, except for insignificant prefactors and addi- 
tive constants. From all systems mentioned above, the 
logistic map shows the scaling laws in the clearest way. 

For strong chaos (Ao > 0), the maximum exponent A 
converges to Ao , if the delay time approaches infinity, and 
indeed we find an exponential convergence, as shown in 
Fig. QJi for the logistic map. But the characteristic decay 
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constant is much closer to zero than expected from the 
viewpoint of the previous Floquct analysis, meaning that 
A(t) is generally larger than the real part of a comparable 
Floquet exponent and decays slower to its limit, 

A - A cx c~ aT , (14) 

with < a < Xq. 

The second anomaly appears in the weak chaos regime 
(Ao < 0) with respect to variation in Ao- The delay- 
normalized exponent At depends on Ao. In contrast to 
the logarithmic divergence in Eq. (jTTJ) , for chaotic dy- 
namics we observe a power law 

A oc Ao" 1 , (15) 

which is clearly exemplified by the logistic map with time- 
delayed feedback, Fig[Tb. For finite delay times, however, 
this power law is incomplete, but by increasing the de- 
lay time one observes that the curves converge to the 
prediction Eq. (fT5]) . 

The most outstanding anomalous scaling behavior oc- 
curs at the transition between strong and weak chaos, 
where A = 0. Instead of the slow growth described by 
Eq. (fT2|) . for large delays the normalized exponent obeys 
a power law 

ArcxV? (16) 

as shown in Fig. [TJd. In the vicinity of this critical point 
one finds a crossover between the divergence Eq. f| 16[) 
and the saturation Eq. ([5]). In the following we show 
that the anomalies are connected to the strength of the 
fluctuations in the driving term Df (x(f)) of Eq. ([2]). 

Stochastic model. Which is the simplest model dis- 
playing anomalous scaling? If we replace the fluctuations 
from the chaotic trajectory by noise in Eq. ([2]), a simple 
model is a one-dimensional linear delay system with mul- 
tiplicative noise 

Z = (Xq + T)(t))z + KZt . (17) 

The variable z > can be understood as a correspon- 
dence to \\5x\\ in a real system. Ao can be identified 
with the sub-exponent and re replaces the feedback gain. 
The term 77 (t) introduces fluctuations with (rj(t)) = 0, 
which model the non-periodic time-dependence of the co- 
efficients Df(x(i)). rj(t) should most naturally be given 
by an Ornstein-Uhlenbeck process with correlation time 
T c . But since we investigate the large delay regime with a 
timescale separation t>T c , we can replace the process 
by white noise, ?y(i) = y/2D£(t) and (£(*)£(*+*')) = <*(*')> 
where D is the diffusion constant of the process. The 
stochastic delay-differential equation is interpreted in the 
sense of Stratonovich, in order to guarantee, that an origi- 
nally smooth process with finite correlation times is mod- 
eled. In this interpretation we can transform Eq. (|17[) by 
w = ln(z), which emerged to be very useful for analytical 



discussion and also for numerical integration. Then the 
logarithm w obeys an equation with additive noise 

w = A + V2D£(t) + kc w ^- w . (18) 

This equation reveals the essential nonlinear character of 
the seemingly linear system Eq. (JT7J). In the absence 
of noise (D = 0) we can directly calculate the Lya- 
punov exponent of this model via an exponential ansatz 
z = zq exp(Ai) or w = wq + Xt, and we obtain the same 
expression as Eq. (j9|) for luq = and re — k. For the gen- 
eral case with noise D > 0, we were not able to derive a 
closed solution for the Lyapunov exponent, which in this 
case would be identical with the drift of the logarithm w. 
The main problem appears in the formulation of a corre- 
sponding Fokkcr-Planck equation for the stochastic delay 
differential equations. The so-called conditional average 
drift, which describes the joint probability distribution 
P(w\w T ) remains generally unknown Nevertheless, 
numerical solutions of Eq. (|18j) verify all three anoma- 
lies, which we found for the chaotic systems. This result 
means, that the introduction of fluctuations changes the 
scaling laws qualitatively, from those of periodic dynam- 
ics to those of chaotic dynamics. 

By means of appropriate approximations, we were able 
to derive analytical limit expressions. Regarding the first 
anomaly in the strong chaos regime, Ao > 0, we obtain 
for D < A 

Aw A + Ke^- An > r . (19) 

It explains the slower convergence of A towards Ao di- 
rectly by means of the multiplicative noise intensity D. 
In the parameter regime corresponding to weak chaos, 
Ao < 0, we could derive a lower bound for the exponent, 
such that the limit expression for the delay-normalized 
exponent becomes 

^X ,K,D)>]n{^)-^(-^j . (20) 

Here ip( z ) is the digamma function with tJj(z) = 
d/dz(]nT(z)), T(z + 1) = zT(z). This formula incor- 
porates both limits for the almost periodic case and the 
case of strong fluctuations. The limit of noise-free dy- 
namics is D -C Ao and reveals fi = In | re/ Ao | , which is the 
expected result. In the case of strong noise or Ao — > 0—, 
it is in leading order fi > —D/Xq, which is the power 
law observed in chaotic dynamics. Considering the last 
and most prominent anomaly, which occurs at the criti- 
cal point Ao = 0, we approximate the dynamics in w by a 
random- walk with a reflecting boundary at w T . The re- 
sult is a one-sided diffusion, which results in a drift with 
the delay-normalized exponent 

At«//>. (21) 

These results agree with our numerical simulations of var- 
ious chaotic systems mentioned above. 
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FIG. 2. Gradual generation of anomalous scaling of maximal 
Lyapunov exponents in the skew Bernoulli map. Top left: 
Parameter plane of (k, r) with lines of constant Ao as labeled. 
Squares, circles and thick solid lines mark the parameter val- 
ues examined in (a)-(c), respectively. Lowest curve in each 
of fig. (a)-(c) corresponds to r = 0, with no fluctuations in 
the linearized equations, middle curve to r = 0.3 and upper 
curve to r = 0.5. (a): Strong chaos Ao > (close to tran- 
sition point), fluctuations decrease the decay constant a of 
A — Ao oc exp(— qt). (b): Critical point Ao = 0, fluctuations 
change scaling from Ar oc W(r) to Ar oc \fr. (c): Weak 
chaos Ao < at r = 1.5 • 10 4 . Fluctuations change scaling 
from fi oc In |fc/Ao| towards ft oc Aq" 1 for Ao — > 0—. 



The parameter r allows us to change the degree of asym- 
metry in the map. For r = the map is identical to the 
original Bernoulli map with constant slope M' Q (x n ) = 2. 
This leads to Ao = ln(l — fc)+ln2, and due to the constant 
slope no fluctuations from the chaotic trajectory enter the 
linearization Eq. (|23p . The Lyapunov exponent A can be 
calculated analytically, and for large delays r>lwe ob- 
tain the same scaling behavior as for the case of periodic 
orbits or steady states as described above. Increasing 
the parameter r gradually introduces the fluctuations of 
the chaotic system into the linearization by the two dif- 
ferent slopes m\ and ni2. In order to study this effect 
of multiplicative noise systematically, we aim to increase 
the parameter r starting at r = 0, while setting the sub- 
exponent Ao to any desired value. To this end, we have 
first recorded a phase diagram Ao(fc,r) for a sufficiently 
large delay. There exist parameterizable curves connect- 
ing r(p) and k(p), such that Xo(k(p), r(jp)) = const. For 
a fixed value of Ao > 0, we scan the delay dependence 
of A for different values of r, and we clearly observe the 
emergence of the first anomaly, as chaotic fluctuations 
enter the linear system. The other two anomalies can be 
demonstrated in an analog way by changing from r = 
to r =/= 0. Again, most significant is the impact of multi- 
plicative noise at the critical point A = 0. 

In summary, strong and weak chaos is related to the 
fluctuations of the coefficients in linear equations defin- 
ing Lyapunov exponents. In particular, at the transition 
from strong to weak chaos, these fluctuations lead to scal- 
ing laws which are different from corresponding ones of 
periodic systems. The scaling of chaotic systems is re- 
produced by linear systems with multiplicative noise and 
time-delayed feedback. 



From noise-free to noisy. Finally, we introduce a sim- 
ple chaotic model, where we can tune the fluctuations of 
the coefficients in its linearized equations by changing a 
parameter r. Thus, we observe a gradual change of the 
three different scaling behaviors discussed before. We 
consider the skew Bernoulli map 

M(x)~\^ X x<\(\ + r) 

r() l^-Kl + r)) x>\{l + r) (22) 

with delayed feedback as in Eq. (fT3"]) . The map has two 
different slopes, namely mi = 2/(1 + r) in the left regime 
and mi = 2/(1 — r) in the right regime. The linearization 
for the Lyapunov exponent A reads 

Sxt+i = (1 - k)M' r {x t )8x t + kM' r {x t - T )5x t _ T , (23) 

and the sub-exponent Ao is determined by the partial lin- 
ear system, in which the delay term has been omitted. 
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